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1 THE CLERK: Appeal number 2007-2513. Attorney Carol 

2 Druzbick. 

3 JUDGE RUGGIERO: Good morning. 

4 MS. DRUZBICK: Good morning. Shall I go ahead? 

5 JUDGE RUGGIERO: You may begin whenever you like. 

6 MS. DRUZBICK: I am here for application serial number 

709/785,443. 

8 Essentially this case is directed to a content-based retrieval system and 

9 method that uses color histograms. 

io Bjiskajly^ym^ 

llaj^erximag^ 

12 are searching for a similar image which also has a histogram. 

13 A feature of this invention is that it converts — in order to compare the 

14 histogram, the query histogram with the search histogram, it converts the 
15 histogram based on color space and color quantization method in order to 
16 compare them. 
17 IniMrd^ 

18 histo grams from different systems when the color space and the color 
^ quantization method were the same. 

20 But the invention disclosed in the present application can convert — it 

21 either converts the query image histogram or the histogram of the image to 
22 be retrieved into a histogram having a color space and color quantization 
23mgjisure.rfjMo^^ 

24 It not only converts the color space, but what it does is it maps the 
25 subspaces of one color space into the quanti bins or a subspace of the other. 
26 And sometimes those overlap. It does that by mapping or projecting a 
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1 

2 volumetric ratio of a portion of the color space i nto the other color space. 
3 either directly or by sampling. 
4 Np^jusLto.gim^ 

5 crea.te a histogram, basically you pick a color space, and there are a bunch of 
6 different color spaces. One is called RGB, which stands for red, green, blue. 
7 And one is HSV. which stands for hue, saturation value. And there are 
8 several other ones. 

9 So you pick a color space. Basically it's a three-dimensional color 

12 What you are doing is basically dividing the color space into 
13 subspaces or bins, and then you classify the pixels in the image. You 
14 basicalfy assign them a value into that color space using an algorithm. And 
15 then you count the number of pixels in each bi n. 

16 You count the number of pixels in each bin, and then you categorize 

17 them into the bins. And then what they usually do is normalize the value. 
18 take the number of pixels in each bin and divide it by the total number of 
19 pixels in the image. And then you assign a binary value to each bin. 

20 This is a way to describe basically color distribution in the image 

21 using descriptive information. 

22 So basically what ours does is it does this histogram conversion which 

23allpws vmM 

24 Now, the rejection in the final office action dated July 13. 2004. 
25 rejected most of the claims over the referenced Bergman. So I'll basically — 
26 and then one Claim 12 over Bergman. I will basically be talking about 
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1 Bergman. 

2 Now, it's applicant's contention that Bergman does not disclose this 

3 conversion of the histogram based on both color space and color 
4auaatizatim.meJliod 

5 JUDGE GROSS: Where is the language based on? The claim 1. 

6 MS. DRUZBICK: Sure. Claim 1 has a histogram converter which 

7 converts the color histogram of one of the extracted query multimedia data 
8 and the multimedia data to be retrieved into a histogram having a color space 
9 and color quantization method of the other. 

10 SojM«j^ 

llMstogxajni^ 

12 they have the same color space and quantization method. 

13 JUDGE GROSS: Okay. But let's say we are converting from the 

14 query to the other, just so that we don't have to keep seeing either this or 
15 this. 

16 MS. DRUZBICK: Okay. 

17 JUDGE GROSS: If you start with RGB 512, so there's your color 

18 histogram for the query. 

19 MS. DRUZBICK: Yes. 

20 JUDGE GROSS: And you want to convert to — what was the other 

21 one? --HVS 512. 

22 MS. DRUZBICK: Yes. 

23 JUJDGEJjRQ^^ 

24 space and a color quantization method to another histogram which has a 
25 different color space. It has the same color quantization method, but it is a 
26 different histogram because one of the things is different. How does your 
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1 claim require that both things be different? 

2 MS. DRUZBICK: I think it does — I think in the word the conversion 

3 — converts. It converts the histogram and converts — it would be changed. 

5 JUDGE GROSS: The histogram is different; the color space is 
6 different. Correct? 

7 MS. DRUZBICK: It says it converts into a histogram having a color 

8 space and color quantization method of the other, so it would require both of 
9 the other. 

io if^mLnpJsJas^ 

1 1 from each other. 

12 JUDGE GROSS: I agree that Claim 13. for example, does require 
13 that both be different. It specifies when the color spaces and the color 
14 quantization methods are different. I don't disagree. But I don't see in Claim 
15 1 that it requires that both be different. 

16 Claim 1 just says it converts one histogram that has two things into a 

n^loxhi^fij^^ 

18 two things are the same. But I don't see that it requires they start out with 
19 both being different. At least one has to be different or there's no 
20 conversion. 

21 But I don't see in the claim that it requires both be different until you 

22 get to. like I said. Claim 13. 

23 MlLDBXlzm 

24 this conversion — I mean it says we are converting having both — to the 
25 other one having both, meaning having a color space and quantization of the 
26 other. So I would say that, you know, into a histogram having a color space 

20 | 6 
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1 of the other and quantization method of the other. 

2 JUDGE GROSS: Well. let's not harp on this. Continue. 

3 MS. DRUZBICK: So basically I think you pretty much understand 
4whM.our.rM^ 

5 basically it's defining a relationship between one description type and 
6 another standard description type, and they have to be derivatives. 

7 I think it's very clear from Bergman that they have to be derivatives. 

8 He doesn't address color quantization method whatsoever. He explicitly 
9 states that they have to be derivatives. While he says the search engine 1902 
Omuiltramto 
l^a^JiiLdg^ 

2 And it's clear from the example that he gives that the quantization 
3 method is the same and the color space has to be a derivative. 

4 Ours, on the other hand, is capable of converting based on both color 

5 space and color quantization method. 

6 We've already talked about Claim 1. 

7 Claiin.4Im.amgJhodJM 

8 a color histogram of one of the input query multimedia data and the 
9 multimedia data to be retrieved into a color histogram having a color space 
20 and color quantization of the other — of the other of the input query 
21 multimedia data and the multimedia data to be retrieved so as to be the same 
22 as each other. 

23 Claim 13 is a method with a converting step. As we previously 

24 discussed. it says that when the color space and color quantization method of 
25 extracting multimedia data and the multimedia data to be retrieved are 
26 different from each other. 
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1 Claim 17 is also a method with a converting step converting the color 

2 histogram when the color space and color quantization method of the query 
3 multimedia data and the color space and color quantization method of the 

5 Going to Claim 28, this is a system claim which has a description 
6 means for describing color space and color quantization method of an 
7 extracted color histogram. And along with the first color quantizer, a second 
8 color quantizer which extracts a color histogram of query multimedia data 
9 using a method which is the same as the described color space and color 

11 AMlhm.Qa^ 

12 whether a color histogram of query multimedia data corresponding to a color 
13 space and quantization method of multidata to be retrieved is stored in 
14 advance and then calculating the similarity. 

15 JUDGE GROSS: Let me ask you a question. Claim 32. where it talks 

16 about stored in advance before. Before what? Judging whether a histogram 

17ig^torgiLmjd^ 

18 has something following it. 

19 MS. DRUZBICK: I think that that might be advances before — an 
20 error. I think it's an error. But I will have to go back and check with my 

21 client on that. 

22 JUDGE GROSS: Okay. Same as Claim 33. 
23 MS. DRUZBICK: 33 also. 

24 JUDGE GROSS: And 29. 

25 MS. DRUZBICK: That I think may be a translation error. 

26 JUDGE GROSS: Just so you know. 
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1 MS. DRUZBICK: Thank you. 

2 JUDGE COURTENAY: The specification you broadly disclose is a 

3 system for retrieving multimedia data. Can you elaborate on that, expand on 

5 their color histogram or images within images? And is it not possible to 
6 have two different images that might have the same color distribution or 
7 have the same color histogram even though they're different images? 
8 MS. DRUZBICK: Yes. Yes. That's one of the drawbacks of 
9 histograms, is that they only do color distribution and not kind of spatial 

11 JUDGE COURTENAY: I guess I'm asking for some additional 

12 insight as to the actual application. You broadly disclosed it. 

13 MS. DRUZBICK: I think actual application is basically searching for 

14 image with a similar histogram. 

15 JUDGE COURTENAY: And not so much trying to match a 
16 particular object according to the color histogram. 

17 MS. DRUZBICK: I think that histograms are limited in their ability 
18 to do that. 

19 JUDGE COURTENAY: Okay. 

20 MS. DRUZBICK: There are a lot of further descriptive meanings that 

21 do spatial information that would give you that. 

22 JUDGE COURTENAY: But this application is actually comparing 
23jjjio,gcs,,|)er,sel 

24 MS. DRUZBICK: It is comparing images per se. but it's comparing 
25 histograms. 

26 JUDGE GROSS: So this would be the first step in trying to find a 
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1 matching image? 
2 

3 MS. DRUZBICK: Yes or one. One of the information they used. So 

5 Any further questions? 

6 JUDGE RUGGIERO: Thank von. 

7 MS. DRUZBICK: Thank you very much. 

8 (Whereupon, the proceedings at 9:50 a.m. were concluded.) 

9 
10 
11 
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